# Surpassing BERT in Chinese and English

ERNIE 2.0 is a continuous pre-training framework proposed by Baidu, which optimizes pre-training tasks through multi-task learning and surpasses BERT and XLNet in multiple Chinese and English tasks.